EXPONENTIAL MIXING OF NILMANIFOLD AUTOMORPHISMS 



ALEXANDER GORODNIK* AND RALE SPATZIER" 

Abstract. We study dynamical properties of automorphisms of compact nilmanifolds 
and prove that every ergodic automorphism is exponentially mixing and exponentially 
mixing of higher orders. This allows to establish probabilistic limit theorems and regu- 
larity of solutions of the cohomological equation for such automorphisms. Our method 
is based on the quantitative equidistribution results for polynomial maps combined with 
Diophantine estimates. 



1. Introduction 

Dynamics and ergodic theory of toral automorphisms have been well understood for 
quite some time. Ergodic toral automorphisms are always mixing and even Bernoulli [14] . 
and have dense sets of periodic points [21]. However, unless they are hyperbolic, the 
toral automorphisms lack the specification property and, in particular, don't have Markov 
partitions [20]. Nonetheless, it is known that ergodic toral automorphisms satisfy the 
central limit theorem and its refinements |19^ ll7j. Regarding the quantitative aspects Lind 
established exponential mixing for ergodic toral automorphisms using Fourier analysis |21] . 
Surprisingly, some of these ergodic-theoretic properties turned out to be more delicate for 
automorphisms of compact nilmanifolds and still remained unexplored. In particular, the 
exponential mixing, which is one of the main results of this paper, has not been established 
and does not easily follow using the harmonic analysis on nilpotent Lie groups. 

1.1. Exponential mixing. Let G be a simply connected nilpotent Lie group and A a 
discrete cocompact subgroup. The space X = G/A is called a compact nilmanifold. An 
automorphism a of X is a diffeomorphism of X which lifts to an automorphism of G. We 
denote by the Haar probability measure on X. Then a preserves fi. The ergodic-theoretic 
properties of the dynamical system a r\ {X, /i) have been studied by Parry [25]. He proved 
that an automorphism is ergodic if and only if the induced map on the maximal toral 
quotient is ergodic, and every ergodic automorphism satisfies the Kolmogorov property. 
In particular, it is mixing of all orders. In this paper we establish quantitative mixing 
properties of such automorphisms. We fix a right-invariant Riemannian metric on G 
which also defines a metric on X and denote by C^{X) the space of 0-Holder functions on 
X. 

Now we state the first main result of the paper. 
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Theorem 1.1. Let a be an ergodic automorphism of a compact nilmanifold X. Then 
there exists p = p{6) G (0, 1) such that for all fo, fi G C^{X) and n G N, 

The proof of Theorem 11.11 is based on an equidistribution result for the exponential 
map established in Section [2] (see Corollary 12.31 below) , which is deduced from the work of 
Green and Tao [12]. This result shows that images of boxed under the exponential map are 
equidistributed in X provided that a certain Diophantine condition holds. We complete the 
proof of Theorem ll.ll in Section[3j The main idea is to relate the correlations (/o, /i o a") to 
averages along suitable foliations in X and apply the equidistribution result established in 
Section [2j In order to verify the Diophantine condition we use the Diophantine properties 
of algebraic numbers. This leads to the proof of Theorem 11.11 under an irreducibility 
condition, and the proof of the theorem in general uses an inductive argument. 

We also establish multiple exponential mixing for ergodic automorphisms of compact 
nilmanifolds. For ergodic toral automorphisms, multiple exponential mixing was proved 
by Pene [26] and Dolgopyat [8]. 

Theorem 1.2. Let a be an ergodic automorphism of a compact nilmanifolds X . Then 
there exists p = p{9) G (0, 1) such that for all fo, ■ ■ ■ , fs G C^{X) and no, ■ ■ ■ ,ns G N, 

The proof of Theorem 1 1.2 1 is given in Section HI The first step of the proof is to establish 
an equidistribution result for images of exponential map in X x • • • x X (see Proposition 
14. 2p . Then we approximate higher order correlations by averages of the exponential map. 
As in the proof of Theorem 11.11 we first consider the irreducible case and then deduce the 
theorem in general using an inductive argument. 

1.2. Probabilistic limit theorems. It is well-known that the exponential mixing prop- 
erty is closely related to other chaotic properties of dynamical systems and, in particular, 
to the central limit theorem for observables f o a"". While one does not imply the other 
in general, the martingale differences approach [131 Ch. 5] usually allows to deduce the 
proof of the central limit theorem from quantitative equidistribution of unstable folia- 
tions. Using this approach, the central limit theorem and its generalisations have been 
established for ergodic toral automorphisms in [19\ [T7] and for ergodic automorphisms of 
3-dimensional nilmanifolds in [3]. Here we extend these results to general nilmanifolds. 

Theorem 1.3. Let a be an ergodic automorphism of a compact nilmanifolds X and f G 
C^{X) with fj^fdn = which is not a measurable coboundary (i.e., f (j)o a — (j) for any 
measurable function (p on X). Then there exists a = cr{f) > such that 

as n —)• oo. 
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We also prove the central limit theorem for subsequences, and the Donsker and Strassen 
invariance principles for ergodic automorphisms of nilmanifolds. We refer to Section |6] for 
a detailed discussion of the results. The main ingredient of the proof is the exponential 
equidistribution of leaves of unstable foliations, which is established for this purpose in 
Section [5l 

1.3. Cohomological equation. Let a be a measure-preserving transformation of a prob- 
ability space {X, fj.) and / : X — t- M is a measurable function. The functional equation 

(1.1) f = (j)oa-(l), (p-.X^R, 

is called the cohomological equation. This equation plays important role in many aspects 
of the theory of dynamical systems (for instance, existence of smooth invariant measures, 
existence of conjugacies, existence of isospectral deformations, rigidity of group actions). 
If a measurable solution (p of (jl.ip exists, the function / is called a measurable coboundary. 
It is easy to see that a solution of (jl.ip is unique (up to measure zero) up to an additive 
constant when a is ergodic with respect to /i. 

We will apply the exponential mixing property to investigate regularity of solutions of 
the cohomological equation. 

Theorem 1.4. Let a be an ergodic automorphism of a compact nilmanifold X, and let 
f £ C°°(X) be such that has a measurable solution. Then there exists a C°° solution 

The first result of this type was proved by Livsic [22] for Anosov diffeomorphism and 
flows. More precisely, if a is an Anosov diffeomorphism and the given C°° function / is 
a measurable coboundary, then the cohomological equation (II. ip has a C°° solution (j). 
There are also versions of this result for Holder functions and functions. Recently, 
Wilkinson |35] has generalised Livsic' results to partially hyperbolic diffeomorphisms that 
satisfy the accessibility property. Automorphisms of nilmanifolds however do not have the 
accessibility property. In fact, the problem of regularity of solutions of the coboundary 
equation for ergodic toral automorphisms, which are not hyperbolic, turns out to be quite 
subtle |33| I16j. Veech |33] has constructed an example of / G C^(T"') which sums to zero 
along periodic orbits, but the cohomological equation (II. ip has no solutions. By [33] . 
if / G C^{T'^) with k > d and (II. ip has a measurable solution, then there exists a solution 
in C^~'^{T'^). We are not aware of any results regarding regularity of solutions of (11. ip for 
a general ergodic toral automorphism when / G C^(T'^) with k < d. 

Theorem 11.41 is proved in Section [71 We use a construction from Section [6| to show 
that there exists a square-integrable solution. Then we use a new method of proving 
smoothness as developed by Fisher, Kalinin and Spatzier in [10]: we consider the solution 
as a distribution on the space of Holder functions and study its regularity along the stable, 
unstable and central foliations of a. While regularity along the first two foliations can be 
deduced using the standard contraction argument, the regularity along the central foliation 
is deduced from the exponential mixing property. 

1.4. Further generalisations. 

• We note that the results established here can be generalised to affine diffeomor- 
phisms of a compact nilmanifold X = G/A. Those are diffeomorphisms a : X ^ X 
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that can be lifted to affine maps a of G, i.e., maps a that have constant derivatives 
with respect to a right invariant framing of G. Since every such diffeomorphism a 
is of the form <t(x) = g^aix) for go € G and an automorphism a of X, our method 
appHes to such maps as weh (see Remark 13.41 below). 

• More generally, one may consider infra-nilmanifolds [6]. Let G be a simply con- 
nected nilpotent Lie group, C a compact subgroup of Aut(G), and P a discrete 
torsion- free subgroup of G x C such that G/T is compact. The space Y = G /T is 
called an infra-nilmanifold. By [H Th. 1], the group A = Gn L has finite index in 
r. Hence, the infra-nilmanifold Y is finitely covered by the nilmanifold X = G/A. 
An affine diffeomorphism of y is a diffeomorphism which lifts to an affine map of 
G. Every such diffeomorphism is of the form g i— >• goct{g), where go G G and a 
is an automorphism of G that preserves the orbits of T. By [3 Theorem 3.4], we 
must have aTa~^ = T. Since by [H Prop. 2] A is the maximal normal nilpotent 
subgroup of P, we deduce that a(A) = aAa~^ = A. Therefore, every affine dif- 
feomorphism of Y lifts to an affine diffeomorphism of X, and our results can be 
generalised to this setting. 

• Our techniques also allow to establish exponential mixing properties for Ti^ -actions 
by automorphisms of nilmanifolds when k > 2. Since this requires more delicate 
Diophantine estimates, we pursue this in a sequel paper [11]. This result has found 
a striking application to the problem of global rigidity of smooth actions. Given 
any G°°-action of Z*', k > 2, on a nilmanifold that has sufficiently many Anosov 
elements, Fisher, Kalinin and the second author showed in [10] that this action is 
G°°-conjugate to an affine action on the nilmanifold. 

• In view of the works of Katznelson |14j and Parry [25] , it is natural to ask whether 
ergodic automorphisms of compact nilmanifolds are Bernoulli. Surprisingly, we 
could not find this result in the literature, and in Section [8] we establish the 
Bernoulli property. While this easily follows from the works of Marcuard [23] 
and Rudolph [29], and the proof does not rely on the main ideas of this paper, we 
include this result in Section [8] to complete our discussion of ergodic properties of 
nilmanifold automorphisms. 

Acknowledgements. We are indebted to J. Ranch for discussions concerning his reg- 
ularity theorems with M. Taylor. Also we thank F. Ledrappier for the reference to Le 
Borgne's work which was crucial to our applications to the central limit theorem. A.G. 
would like to thank the University of Michigan for hospitality during his visit when the 
work on this project had started. R.S. thanks the University of Bristol for hospitality and 
support during this work. 

2. Equidistribution of box maps 

Let G be a simply connected nilpotent Lie group, A a discrete cocompact subgroup, 
and X = G/A the corresponding nilmanifold equipped with the Haar probability measure 
H- We fix a a right invariant Riemannian metric d on G which also defines a metric on X. 
Let C{G) be the Lie algebra of G and exp : C{G) — )• G the exponential map. The aim of 
this section is to investigate distribution of images of the maps 

R'' ^ X gi exp(i(t))5f2A 



EXPONENTIAL MIXING OF NILMANIFOLD AUTOMORPHISMS 5 

with gi,g2 G G and an afRne map t : M*"' — )• 

The lattice subgroup A defines a rational structure on C{G). Let tt : G — )• G/G' denote 
the factor map, where G' is the commutator subgroup. We also have the corresponding 
map : C{G) C{G/G'). We fix an identification G/G' ~ C{G/G') ~ M' that respects 
the rational structures. 

We call a box map an afhne map 

i:B:= [0,ri] X ••• X [CT,.] 

of the form 

(2.1) i■.{tl,...,tk)^v + tlWl^ VtkWk 

with v,wi, . . . S C{G). We denote by 

1^1 ■.= Ti---Tk 

the volume of the box B and by 

min(i?) := min Tj, 

i=l,...,k 

the length of the shortest side of B. 

Theorem 2.1. There exist Li, L2 > such that for every 5 € (0, 1/2) and every box map 
L : B ^ C{G) as in 112. one of the following holds: 

(i) For every Lipschitz function f : X ^ M, u £ C{G), and g £ G, 



(2.2) 



/(exp(u) exp{L{t))gA) dt- j^f d^i 



<m\\L^p. 



\B\ _ 

(ii) There exists z G Z'\{0} such that 

(2.3) \\z\\<^b'^^ and \{z,D'K{wi))\ d'^'' /Ti for all i = 1, . . . ,k. 

Here and in the rest of the paper we explicitly list dependences of implied constants on 
relevant parameters. In particular, in (12. 3p the implied constants are independent of the 
box map. 

Proof: We suppose that (i) fails for some Lipschitz function f,u£ C{G), and g £ G. 
Then will show that (ii) holds. We pick L >2 such that 

(2.4) max{||u||, Ti . . . ,Tk\\wk\\} < S~^. 

Making a linear change of variables in the integral (j2.2p . we arrange that Tj > 1 and 

For xi,X2,X3 G C{G), we consider the map 

P(xi,X2,X3) := exp(xi) exp(x2 + 2:3) exp(-X2) exp(-xi). 

We note that G can be equipped with a structure of algebraic group so that exp is a 
polynomial isomorphism. Hence, the map P can be written as 

P(xi,a;2,X3) = exp(pi(j;i, 2:2, 3^3)61 H V Pd{xi,X2,xz)ed) 

for some polynomials pi. Since P{xi^X2, 0) = e, these polynomials satisfy pi(xi, 2:2, 0) = 0. 
Hence, assuming that 11x3 1| < 1, we obtain 

|k(xi,X2,X3)| « (1+ ||X1||)'1'=S(P')(1+ ||X2||)'^'=S(^»)||X3||, i= l,...,ci. 
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Since in the neighborhood of the origin, 

die,P(xi,X2,X3)) <^ max \pi{xi,X2,X3)\, 

i=l,...,d 

we deduce that there exists Cq > 2 such that for every e E (0, 1/2) and xi,X2,X3 G >C(G) 
satisfying ||xi||, ||x2|| < (A; + l)e~"'" and ||x3|| < ke^°, we have 

(2.5) d{e,P{xi,X2,X3)) < e. 

We set s = \5~'^^] , where C > Cq is sufficiently large and will be specified later (see 1)2.70 
and (I232]l - (im] l below). Let 

M := {(ni, . . . , nfc) : = 0, . . . , TV, - 1}, 

where iVj := [Tjs] > s. We consider the polynomial map 

p{n) := exp(ti) exp | v + —Wi \ g, n G J\f. 



1=1 



For ti G 



\ a 1 e n 



we apply (12. 5p with 



A: fc 

— Wj, X3 := 2^ (^tj 1 Wi, e = 6 . 

1=1 ^ i=l ^ 



It follows from (1231) that 



xi\\ < 6^, 

k k 

<S^ + J2{Ni-l)s^^\\wi\\ <6^ + Y,Ti\\wi\\ < {k + l)6^ 



X2 



X3 



i=l 



i=l 



< ^s~^\\wi\\ < ks'^ < k6^^. 



i=l 



Hence, (|2.5|) gives 



(2.6) d ^p(n)A, exp(ti) exp + Uwi^ gA^ 
<d ^e, exp(ii) exp + tiWi^ gp{n)~^^ 



-d j e, exp(u) exp ( v + tiWi J exp ( v + — it^i j exp(n) ^ j < (5 



1=1 



i=l 



For n = (ni, • • • , n^) G M , we set 

[ni ni + 1 



X • • • X 



1 

s s 
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It follows from ()2.6p that for every Lipschitz function / and n £ J\f, 



fip{n)A)\Bn\ 



/(exp(u) exp{L{t))gA) dt 



<S'^s-'^\\fUip. 



We also observe that B D UneA/Bn, and 



B 



U 

\n&Af 



< ks'^Ti • • • Tfc < A;s"''"^A^i • • • Nf,. 



Therefore, we deduce that 



y2 f{p{n)A)\Bn\ - [ /(exp(^/)exp(6(0)ffA)dt 

^^^r JB 



<(<5^ + A;s^i)s"'=Afi---iVfc||/||Lip, 



f{p{n)K)\Bn\- / /(exp(n)exp(.(t))<7A)c?t 



+ ks-^-^Ni---Nk\\f\\Lip 



and 



< 



--i— 5^ /(p(n)A) - / /(exp(n)expWf))ffA)di 
i— /(p(n)A) 



+ 



1 



|5| iVi---iVfc 



A^i • • • iVfc 



f{exp{u) exp{L{t))gA) dt 



<{6'^+ks-') ||/||Lip+(l 



Lip 



(A^i - 1) • • • (iVfc - 1) 



Lip 



Ni---Nk 

with some > 0. Here in the last line, we used that Ni = [Tjs] > s = \6~'-"^~\. We 
choose C = C{k) > Co > 0, so that 

(2.7) + ckd^^ < 36/4. 

Then since we are assuming that (|2.2|) fails, we deduce from the previous estimate that 



(2.S 



>{6-6^- Ckd' 



CL 



Lip > S/^f\\L^p. 



Now we apply [121 Th. 8.6] to the polynomial map p{n). Note that 



TT {p{n)) = Dtt 



i u + V + —Wi I 

V tt' J 
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and 



vr (p(n)) - vr {p{n - e,)) 



D7r{wi) 



By [El Th. 8.6], there exist Li, L2 > such that for every p G (0, 1/2) and A^i, . . . , iVfc > 
1, one of the fohowmg holds: 

(i') For every Lipschitz function / : X — >• M, 



(2.9) 



< 



Lip- 



(ii") There exists z G Z'\{0} such that 



(2.10) 



< p ^1 and dist ( ( z 



DTT{Wi) 



where the impHed constants depend only on the degree of the polynomial map. 

Comparing (12. Sp and (j2.9p . we deduce that (ii") holds with p = 5/4, and there exists 
z G Z'\{0} such that 

DlT{Wi) ' 



(2.11) 



\z\\ < 5 and dist ( z 



^S-^^Ni, i = l,...,k. 



Since \\wi\\ < 1, we obtain 
(2.12) /- 



Taking C = C(Li) > sufficiently large, the above estimate implies that 



(2.13) 
Then 



< 1/4. 



dist I ( z 



D7r{wi 



and it follows from ()2.1ip that 

Dt:{w,))\ < s5-^^/N, < i = l,...,k. 

Hence, (j2.3p holds, as required. This completes the proof of the theorem, o 



We call a box map l, defined as in p.ip . (ci, C2)-Diophantine if there exists at least one 
vector w G Q := [—1, 1]D-k{wi) + • • • + [—1, l]D-K{wk) such that 

(2.14) \{z,w)\>ci\\z\\-^'' for all z G Z^{0}. 

We emphasize that only one element of 0, has to satisfy the relevant Diophantine con- 
dition. This allows for the following remark which we will use later, e.g. in the proof of 
Theorem 13. 1[ 
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Remark 2.2. Let t be a [01,02) -Diophantine box map, W the subspace spanned by the 
image of t, and S a compact subset of GL(VF). Then there exists a constant c = o{S) > 0, 
which only depends on S, such that for all s G S, the box map sot is (cci, C2)-Diophantine. 
Indeed, since 5 is compact, there exists c = c{S) > such that for every s £ S, 

[-1, l]DTr{wi) + ■■■ + [-1, l]DTT{wk) C [-o-\o-^]Dtt{swi) + ■■■ + [-o-\o-^]DTr{swk). 

Uw€ [-1, l]i:>7r(u;i) H h [-1, l]D7r{wk) satisfies (l2Ji]) . then ow G [-1, l]D7r{swi) + 

■ ■ ■ + [—1, l]Z)7r(su;fc) and satisfies (j2.14p with ci replaced by cci. Hence, the box map so i 
is (cci, C2)-Diophantine. 

The following corollary will play a crucial role in the next section. 

Corollary 2.3. Given 6,01,02 > 0, there exists n = n[o2,0) > such that for every 
9 -Holder function f : X ^ M, u £ C{G), (ci, 02)-Diophantine box map t : B ^ ^{G), and 
X G X, we have 

^ ^ /(exp(n) exp(i(i))^) dt = j^fdfi + 0,,,,,{mm{Br^\\f\\co). 

Proof: We first give a proof assuming that the function / is Lipschitz. 
We write the box map l as 

i(t) = v + tiwi H h tkWk, t e B = [0,Ti] X ■ ■ ■ X [0, Tk] 

with v,wi, . . . ,Wk G W and Ti , . . . , > 0. 

We take k, e > such that > C2 and moreover > C2, where Li and 

L2 are as in Theorem 12. 11 Let 5 = min(i3)~'^. We first assume that min(i?) is sufficiently 
large, so that 6 < 1/2. Then by Theorem l2.lt either 



(2.15) 



M Ib -^^^^^^^^ exp{L{t))x) dt- j^fdn 



<mmiB)-'^\\f\\L^p 



for all Lipschitz functions / : X — )• M, u G C{G) and x G X, or there exists z G Z'\{0} 
such that 

||z|| < mm{B)^^'^, 
I {z,DTT{wi)) I < min(B)^2«/Ti < min(S)^=^''^\ i = 1,... 

If the latter holds, then we deduce that there exists z G Z'\{0} such that 

I {z,DTT{wi)) I < min(S)--^2e^in(B)^2(K+€)-i ^ min(B)--^2€||^|| 
< min(5)--^2e||^||-c2 

for all i = 1, . . . ,k. Writing w = Yli=i (^iDT^{wi) with G [—1, 1], we also deduce that 



{z, Di:{w)) \<^\{z, DTr{wi)) \ < min(B)" 



■-I'2e||2||-C2 



1=1 
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When mm{B) is sufficiently large, this estimate contradicts ()2.14p . Hence, we conclude 
that when mm{B) > Tq = ro(ci, C2), (|2.15p holds and 

-i- / /(exp(n) exp(t)x) = / / d/i + 0(min(S)-"||/||i.p). 

It is also clear that this estimate holds in the range [0, Tq] with the implicit constant 
depending on Tq, and this completes proof of the corollary for Lipschitz functions. 

For Holder functions, we use the following well-known approximation result. While 
we only use the estimate of the Lipschitz norm here, we will need this lemma in full in 
Section [71 

Lemma 2.4. Given e > and < 9 < 1, for any 9 -Holder function / : X — )• M, there is 
a C°° function : X — t- M which satisfies the following bounds 

(2.16) ||/^_/||^o<el/||c« and Wfehip <^ e-^'^^'^^-'WfWco. 
Furthermore, for all I G N, 

(2.17) WfeWc^ «^ ^""''"(^^-'ll/llco- 
Proof: Given a ^-Holder function / : X — )• M, we set 

/e(x) := / (j)e{g"^)figx)dm{g), 
Jg 

where m denotes the Haar measure on G, and (pe is a nonnegative function such that 

Ue\\L^p<^e-''''^^''^~\ [ <P,dm = l, suM^e) C B,{e). 

Jg 

Then 

II/, - /lico < max / Mg-')\f{gx) - f{x)\ dm{g) < e'\\f\\ce. 
Jg 

For x,y € X satisfying d{x, y) < e, we can write y = hx with h € B^{e). Then 

\fe{x) - fe{y)\ < [ \M9-') - Mh9-')\fi9x)\ dmig) « e-^^'-W-i/Hco. 
Jg 

Hence, 

||A||L.p«6-'^^"^W-i/|bo. 

We can further assume that <j)^ satisfies for all / G N, 

||,^,|b. e-'^^-W-^||</)|b., 

and it follows that 

||/,|b. e-'^^'"(^)-'||/||co, 

as the lemma claims, o 
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Returning to the proof of Corollary 12. 3^ we obtain 
^ /(exp(n) exp(t)x) = ^ ^ /.(exp(n) exp(t)x) dt + 0(el/|b.) 

= [ fd^^ + o({e~^'^^''^~'nMBr'' + e'mco)■ 
J X 

To optimise the error term, we set e = min(i3)^'^/('^'™('''-)+^"*"^). We readily obtain the 
corollary for Holder functions, o 

We remark that the procedure just outlined applies quite generally, and allows to go from 
estimates for Lipschitz functions to ones for Holder functions. In particular, exponential 
mixing for Lipschitz or even only smooth functions always implies exponential mixing for 
Holder functions. 

3. Mixing 

In this section, we prove Theorem II. li on exponential mixing. Let us recall the statement: 

Theorem 3.1. Let a he an ergodic automorphism of a compact nilmanifold X = G/A. 
Then there exists p = p{9) S (0, 1) such that for all 9 -Holder functions /o, /i : X — t- M and 
n G N, 

J^fo{x)fiia^{x))di^{x) = (^J^fodp^ iJx-^"^^) ^'^^P''\\f°\\c4fi\\co)- 

We denote by fi the Haar probability measure on X, and by m the Haar measure on G 
which is normalised, so that m{F) = 1 where F is a fundamental domain for G/A. 

Every automorphism 13 of G defines a Lie-algebra automorphism D/3 : C{G) — t- C{G) 
such that /3 o exp = expoD/3. If /?(A) C A, then Df3 preserves the rational structure of 
CiG) defined by A. 

As in Section [21 we equip the group G with the structure of an algebraic group, so that 
exp is a polynomial isomorphism. More precisely, one can construct a basis, a so-called 
Malcev basis, {ei, . . . , ed} of C{G)q, such that the map 

R'^ ^G:{ti,...,td)^ exp(tiei) • • • exp(tderf) 
is a polynomial isomorphism, 

A = exp(Zei) • • • exp(Zerf), 

and 

F := exp([0, l)ei) • • • exp([0, l)ed) C G 

is a fundamental domain for G/A (see (SI 1.2.7, 5.1.6, 5.3.1]). 

We present the proof of Theorem 13.11 in two stages: in Section 13.11 we give a proof 
assuming a suitable irreducibility condition, and in Section [3.21 we reduce the proof to the 
irreducible case using an inductive argument. 
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3.1. Proof under an irreducibility assumption. Let u; be a (real or complex) eigen- 
vector of Da acting on C{G) (giC with eigenvalue A such that |A| > 1. Such an eigenvector 
exists by the following lemma. 

Lemma 3.2. // a is an ergodic automorphism of a nontrivial compact nilmanifold X = 
G/A, then Da has an eigenvalue A with |A| > 1. 

Proof: By ^ 5.4.13], KG' /G' is a lattice in G/G' ~ The automorphism a defines 
a linear automorphism of the torus T := G/{AG') ~ M'-fL, where L is a lattice in M', and 
there is an a-equivariant map X ^ T induced by vr. Since a\^i preserves the lattice L, 
it follows that the eigenvalues of a\^i are algebraic integers. If we suppose that all these 
eigenvalues satisfy |A| < 1, then it follows from [9l Th. 1.31] that all the eigenvalues of 
a\^i are roots of unity. Then the automorphism a\T is not ergodic, and this contradicts 
ergodicity of a. Hence, a\^i has an eigenvalue A with |A| > 1, and this implies that Da 
has such an eigenvalue as well, o 



Since Da preserves the rational structure on C{G) defined by the lattice A, we may 
choose the eigenvector w with coordinates in the algebraic closure Q. In the real case, 
we denote by W the corresponding one-dimensional eigenspace of C{G). In the complex 
case, we denote by W the two-dimensional subspace {w,w) n£(G), where w denotes the 
complex conjugate. We note that in a suitable basis 

(3.1) Da\w = r ■ Lo 

where r = |A| > 1 and a; is a rotation by angle Im(A). 

In this subsection, we give a proof of Theorem l3 . 1 1 assuming that Dtt(W) is not contained 
in any proper rational subspace of M'. This condition is used to guarantee existence of a 
"generic" vector in D'ir(W) given by the following lemma. 

Lemma 3.3. Let V C M.^ be a subspace defined over Q n M such that V is not contained 

in any proper subspace defined over Q. Then there exists w £ V D Q whose coordinates 
are real numbers linearly independent over Q. 

Proof: Let {vi, . . . , Vg} be a basis of V whose coordinates Vij are in Q n M. We denote 
by K the field generated by these coordinates. Clearly, is a finite extension of Q. We 
can pick ai, . . . ,as G Q n M which are linearly independent over K (for instance, we can 
take a sufficiently large finite extension K' of K and choose {ai} from a basis of K' over 
K). 

We set w = J2i=i OiiVi- Suppose that there exists c S Q' such that c • w = 0. Then we 
have 



c-w=y c,- > aiVii = > > c^Vii = 0. 




Now because Cj%- is in K, it follows that Yl!j=i ^j'^ij — ^'^d c - V = d. 

Since V is not contained in any proper rational subspace, we conclude that c = 0, which 
concludes the proof, o 
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As we remarked above, the subspace W is defined over Q. Moreover, since W is invariant 
under complex conjugation, it is defined over Q n M. This implies that the subspace 
D7r{W) is also defined over Q n M. Hence, by Lemma 13.31 DT^iW) contains a vector w 
whose coordinates are real algebraic numbers that are linearly independent over Q. By [21 
Th. 7.3.2], there exist ci, C2 > (in fact, one can take any C2 > / — 1) such that 

(3.2) \{z,w)\> ciWzW-"^ for all z G Z^{0}, 

This will allow us to apply Corollary O to box maps M'i™(^) W. 

Let E C C{G) be the preimage of the fundamental domain F under the exponential 
map. Since E is the image of [0, 1)"^ under a polynomial isomorphism, it is a domain in 
C{G) with a piecewise smooth boundary. We fix a basis of C{G) which contains the basis 
of W and consider a tessellation of C{G) by cubes C of size e with respect to this basis. 
Then 



< e. 



(3.3) 

CCE 

Using the above notation, we rewrite the original integral as 



E-[JC 



(3.4) / /o(x)/i(a"(x))d/x(x)= / fo{gA)fi{a^{g)A)dm{g) 
Jx Jf 

= / /o(exp(M)A)/i(exp((L>a)"u)A)dM, 
Je 

where we used that the Haar measure on G is the image of a suitably normalised Lebesgue 
measure on C{G) under the exponential map (SJ 1.2.10]. It follows from (|3.3|) that 

(3.5) / /o(exp(^z)A)/i(exp((Z)a)"u)A)dn 

JE 

= Y. I /o(exp(n)A)/i(exp((Z)a)'^n)A)dn + 0(e||/o||co||/i||co). 

CCE'''^ 

For every cube G in the above sum, we fix uc £ G. Then for all u € C, 

|/o(exp(u)A) - /o(exp(uc)A)| < d(exp(M), exp(uc))||/o||Lip < e^ll/olb"! 

and 



(3.6) [ /o(exp(n)A)/i(exp((L>a)"u)A)du 

Jc 

=/o(exp(nc)A) / Mexp{iDaru)A)du + 0{e'\\M\co\\fi\\co)- 



Since the cubes G are chosen in a compatible way with the subspace W, they can be 
written as C = B' + B where i? is a cube in W and B' is a cube in the complementary 
subspace. Given a cube B C W , we introduce a box map lb ■ 

]gdim(W) ^ defined with 

respect to the fixed basis of W, such that ^^([O, e]'^™^^^) = B. Since a; is a rotation, it 
follows from Remark 12.21 that for some c > 0, each of the box maps 
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is (cci, C2)-Diophantine. Therefore, applying Corollary \2.3\ we obtain there exists k > 
such that for every v E >C(G), 

(3.7) 

^ / MeMv + {Darb)A) db = / /i(exp(i; + (Z)a)^B(i))A) dt 

^ (^n^)-dim(Ty) /■ /i(exp(r; + a;'^6B(t))A)(it 

J[0,r"e]dim(W') 



'X 



= / /id/i + 0((r 
Jx 

Since this estimate is uniform over v G we deduce that 

^ / f,{expi{Daru)A)du = —^ [ [ /i(exp((Z)a)"6' + (Z)a)«6)A) 

= / /id/i + 0((r"e)-«||/i|b.). 
Combining the last estimate with (j3.5p and (j3.6p . we deduce that 



/o(exp(n)A)/i(exp((Z)a)'^7/)A)du= /o(exp(nc)A)|C| j j^fidfi 

^^[[^ |C|(r"6)-'^ + 6^^ II/, 
Since /o is ^-Holder and diam(C) <^ e, we obtain using (j3.3p . 
(3.8) ^ /o(exp(nc)A)|C| = ^ / /o(exp(^.)A) + ©(e^/oHcO 

fo{exp{u)A)du + 0{e'\\fo\\cB) 
fodi^ + 0{e'\\fo\\co)- 



ollcll/Hlcs 



Hence, 

^ /o(exp(n)A)/i(exp((Z)a)"^x)A) du = {^j^ h dl^ /o d/U^ 

+ o((r"6)-'^ + e^)||/o|b«||/i||c«)- 
To optimise the error term, we choose e = r~^'^/^'^'^^\ Then 

/o(x)/i(a"(x))dM(^) = / /o(exp(n)A)/i(exp((I)a)"n)A)(i^x 



X 



^/od^J l^y^/i^i^) +O(p"||/o||c«ll/i|lc0 
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where p = r-'^^/(''+^) G (0, 1). This proves Theorem 13.11 under the irreducibihty assump- 
tion. 

We also observe that Corollary 12.31 implies the following stronger version of estimate 
(|3.7p : for every h £ G, automorphism /3 of G such that /3 = id on G/G' , and v E >C(G), 

^ [ h{h/3{eMv + {Dart))A)dt= j /i + O ((r"6)"«||/i|b«) • 
Indeed, using that /3 o exp = expoZ)/3, we obtain 

^ ^ /i(/i/3(exp(^; + {DaTt))K) dt 

^(^n^)-dim(H/) I f^{eM{Dfi)v + {Dfi)uj^iB{t))k)dt. 

J[0,r"e]dim(W) 

Since {Dtt){DI3) = Dtt, the box maps 

{Df3)v + {D/3)u;''LB{t) 

are also (cci, C2)-Diophantine, and the same estimate as in (j3.7p holds. Therefore, the 
above argument implies that 

(3.9) ^/o(x)/i(/i/3(a"(x)))dMx) = (^/o*^/^) /i ^/") + O (p^H/olb" ll/illc«) 

uniformly on /i G G and automorphisms /? which preserve A and act trivially on G/G' . 

Remark 3.4. Let cr : X —t- X be an affine diffeomorphism of a compact nilmanifold X. 
Then a{x) = gia{x) for gi G G and an automorphism a, and a"{x) = gna"{x) for gn € G. 
Since the estimate ()3.9p is uniform over S G, it also holds for affine diffeomorphisms. 
This allows to extend the main results of this paper to affine diffeomorphisms. 

3.2. Proof of mixing in general. We prove Theorem 13. II in general using induction on 
the dimension of the nilmanifold X. 

Let w G -^^(G) (8> C be an eigenvector of the automorphism Da with eigenvalue A of 
maximal modulus. Since a is ergodic, |A| > 1 by Lemma [3^21 We set W = C{G) n {w,w). 
Since Da\w has eigenvalues A and A, it follows either that Dalj^y^vF] must have eigenvalues 
of modulus |Ap > |A|, or [W,W] = 0. Hence exp(T^) is an abelian Lie subgroup of G. By 
[32l Ch. 3, Sec. 5], there exists a closed connected normal subgroup M containing exp(14^) 
such that M/(MnA) is compact, and for almost every g € G, we have exp(W)gA = AdgA. 
Replacing the lattice A by gAg~^, we may assume without loss of generality that 

(3.10) exp(W^)A = MA. 

Lemma 3.5. (i) The group M is a-invariant. 

(ii) Denoting by tt : M ^ M/M' the factor map, DTr{W) is not contained in any 
proper rational subspace of C{M/M'). 

(iii) [G,M] < M'. 

Proof: We note that the group M can be described as the smallest closed connected 
normal subgroup containing exp(14^) and intersecting A in a lattice ([32l Ch. 3, Sec. 5]). 
Equivalently, M is the smallest closed connected subgroup whose Lie algebra C{M) is an 
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ideal in C{G) that contains W and is defined over Q with respect to the rational structure 
defined by A. To show that M is invariant under a, we observe that 

£(a(M)) = Da{C{M)) 

also satisfies the above properties, and so does 

£(M n a(M)) = C{M) n Da{C{M)). 

Therefore, a{M) = M by minimality of M proving (i). 

To prove (ii), we consider the torus factor MA/A — )■ T := MA/(AM') induced by the 
map TT. If 7r(W) is contained in a proper rational subspace of C{M/M'), then the image 
of Dtt(W) in T is not dense, which contradicts (j3.10p . This shows (ii). 

Since the vector w has coordinates in Q, so does the vector D'k{w). For a G Gal(Q/Q), 
we denote by D'k{wY its Galois conjugate. Then (^D'k{wY '■ c G Gal(Q/Q)) is a rational 
subspace, contains Dtt(W) and, hence, cannot be a proper subspace. This shows that 
Gal(Q/Q) acts transitively on the eigenvalues of Da in V := C{M/M'). In particular, it 
follows that V does not contain any proper rational subspaces invariant under Da. Now 
we consider the adjoint action Ad of G on V. Since G is nilpotent, the set V'^ of G-fixed 
points in V is not trivial. Since is (DQ;)-invariant and rational, we conclude that 
= V. This implies that every g ^ G, 

{M{g) - id){C{M)) c C{M)\ 

and the last claim of the lemma follows, o 



The nilmanifold X = G/A fibers over the nilmanifold Y = G/{MA) with fibers isomor- 
phic to Z = MA/ A ~ M/ (M n A), and we have the disintegration formula 

(3.11) [ fdfi= [ [ f{yz)dfiz{z)df,Y{y), feGiX), 

JX JyJz 

where /xy and ^iz denote the normalised invariant measures on Y and Z respectively. 
Since the groups M and A are a-invariant, a defines transformations of Y and Z, and we 
obtain 



(3.12) y^/o(x)/i(a-(x))d/i(x) = (^y^/o(yz)/i(a"(y)a-(z))(i/iz(^)J (i/^y(y) 

/o(52)/i(a"(5)a"(2))(i/iz(2)^ dmpig), 

where F C G is a bounded fundamental domain for G j (Af A), and mp denotes the measure 
on F induced by /iy. 

We claim that for some fixed p G (0, 1) and every g ^ F ^ 



(3.13) J^fo{gz)Ma''{g)a^{z))dpz{z) = ^JJo{gz)dfiz{z)j ^J^fi{a^{g)z) dpz{z] 

+ O(p"ll/olb«ll/i|lc«) 
uniformly on g G F. To prove the claim above, we write 

a'^{g) = am\ with a G F, ?n E M, A G A. 
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Then 



foigz)h{a'\g)a''iz))dfiziz)= / fo{gz)h{amPia^{z))) dfiz{z), 
z Jz 

where /3 denotes the transformation of Z mduced by the automorphism m i— )■ A?nA~^, 
m € M. We note that /3 acts trivially on M/M' by Lemma 13.51 Let 

(poiz) ■■= foigz) and (j)i{z) := fi{az) with z £ Z. 

Since g,a G F, we have 

ll'/'ollce < ll/ollce and ||(/)i||ce < ll/lllc*' 
and since a(MA) = a" (5) (MA), 

:iidfiz= / fi{a^{g)z)dfiz{z). 
z Jz 

Therefore, it follows from (|3.9p that there exists p £ (0, 1) such that 

Mz)M^l3{»''iz))))dpz{z) 

idfiz^ (^j^cpidpz^ +O(p"||(/.o||c9||0i|lcO 
h{9z)dfiz{z)] ( [ Ua^{g)z)dfiz{z)]+0{p-\\fo\\c4fi\\co) 



z 



uniformly over g,a £ F, m £ M, and automorphisms (3 Z which act trivially on M/M' . 
This proves the claim (|3.13p . and we conclude that 



(3.14) / Ux)h{a^{x))dp{x)= / /o(y)/i(a"(y))d^y(2/) + 0(p"||/o|b«ll/i|lc«), 
Jx Jy 

where the functions /j : y — )■ M are defined by y 1— )■ fi{yz) dpz{z). We note that 

fi dpY = fi dp. 
Y Jx 

Since dim(y) < dim(X), Theorem 13.11 follows from (j3.14p by induction on dimension. 

4. Multiple mixing 

In this section, we prove Theorem II. 21 on multiple exponential mixing. Let us recall the 
statement: 

Theorem 4.1. Let a be an ergodic automorphism of a compact nilmanifolds X = G/A. 
Then there exists p = p[9) £ (0, 1) such that for all 6-Holder function fo, ■ ■ ■ , fs : X — t- R 
and no, . . . , G N, 

£ (^n/^(«"'(^))) dp{x)=fi(^l^f,dp^ +0 (^p"^'^'^^i"-"^inii/^iic«^ • 



18 



ALEXANDER GORODNIK AND RALF SPATZIER 



We note that without loss of generahty, we may assume that no = and < ni < • • • < 
ris- 

As a preparation for the proof, we estabhsh a result regarding equidistribution of images 
of box maps that generalises Corollary 12.31 We call a box map, defined as in (|2.ip . cq- 
bounded if \\wi\\ < cq for alH = 1, . . . , A;. 

Proposition 4.2. Given cq,ci,C2,9 > 0, there exists k = k{c2,0) > such that for all 
-Holder functions /i, . . . , : X — )• M, ui, . . . ,Us £ >C(G), automorphisms /3i, . . . , /3s of G 
such that (3i = id on G/G', < ri < ••• < r^, CQ-bounded and {ci,C2)-Diophantine box 
maps Li, . . . ,Ls : B ^ ^{G), and xi, . . . ,Xs £ X , we have 



Proof: We first note that using the approximation argument as in the proof of Corol- 
lary 12.31 one can reduce the proof of the proposition to the case when the functions are 
Lipschitz. Since this part is very similar to the proof of Corollary 12.31 we omit details, 
and assume right away that the /j's are Lipschitz. 

The proof involves applying Theorem l2.1l to the nilmanifold X'^ = G^ / A.^ . Let Li,L2 > 
be the constants from this theorem. To simplify notation, we write a = (t{B, ri, . . . , r^). 



Let 5 = a where k > is chosen so that '^{l^+L2)+i ^ moreover (^+'^)(^i+-^2)+^ ^ 

02 for some fixed e > 0. First, we assume that a is sufficiently large so that 6 G (0, 1/2). 
We write the box maps ^ as 

ii{t) = Vi + tiwl^^ + ■■■ + tkwf\ t G B = [0, Ti] X • • • X [0, Tfc], 
with Vi, w^p G ^{G) and Ti, . . . T^, > and set 




where a{B, n, . . . 



min{min(rii?), r^r. 



.-1 

s-l 



,...,r2r^^}. 



/ = /i . . . : ^ M, 
u= {ui,...,us) G C{Gy, 
i-.B^ C{Gy :t^ {D(3iii{rit) 
X = (xi, ... ,Xs) e x^ 



Dp,is{r,t)) 



Then 




Applying Theorem 12.11 we deduce that for every 5 G (0, 1/2), either 



(4.1) 
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or there exists (zi, . . . ,Zs) G (Z )^\{0} such that 



(4.2) 
and 

(4.3) 



pill) ■ 



\zs\\ < 



a 



kL 



J2rj(zj,DTrDf3j{w 



< 6~^ymm{B) = a""^'' / mm{B) for alH = 1, . . . , A:. 



We note that since /3j = id on G/G' , we have DirDfSj = Dir. 

Suppose that (|4.2p ~ (|4.3p holds. Since HiL'j*^!! < cq by assumption, using the triangle 
inequality we deduce that 



s-l 



Zs,DTi{wf)^ < a^^Vmin(rsS) + a''^V(rsr-^) < a^(-^i+^2)-i 



for alH = 1, . . . , A:. Then by (jO 



< -(Li+L2)e| 



-C2 



Since the box map ig is (ci, C2)-Diophantine, there exists Wg € X^(Li[~1) 1]-D7r(wi*'*) which 
satisfies ()2.14p . On the other hand, it follows from the previous estimate that 



(w 



i=l 



< fj-(i'l+^2)^||^||-=2. 



When a is sufficiently large, this estimate contradicts (j2.14p . unless Zg = 0. Hence, we 
deduce that Zg = 0. 

Now we repeat the above argument and deduce from ()4.2p - (|4.3p that 



s-2 



z,_i,i?7r(<i^)^ « a"^Vmin(r,_ii?) + ^(T'^^V(r,_ir-i) < a'^(^H-^2)-i 

i=i 

for all z = 1, . . . , /c, and ultimately that Zs~i = 0, when a is sufficiently large. Hence, we 
conclude that (zi, . . . , z^) = when a > (Tq = (7o(co, ci, C2). Therefore, in this range ()4.ip 
holds with 5 = o""'^. This proves the claim of the proposition for sufficiently large a. It is 
also clear that this estimate holds in the range [0, uo] with the implicit constant depending 
on (Tq. This completes the proof of the proposition, o 



4.1. Multiple mixing under irreducibility assumption. In this section, we prove 
Theorem 14.11 under the irreducibility condition as in Section 13.11 Namely, W denotes a 
(Da)-invariant subspace of C{G) such that DiiiyV) is not contained in a proper rational 
subspace and p.ip holds. 



20 



ALEXANDER GORODNIK AND RALF SPATZIER 



As in (13. 41). we obtain 



J^Mx) (^n/iK'(x))j (i/z(x) = ^/o(exp(n)A) (jlfi{eM{Dar^)^?j du. 



As in Section 13.11 we tessellate the region E by cubes C of size e which are compatible 
with the subspace W and get 

(4.4) ^/o(exp(n)A) |^n/*(«^P((^«)"'^)^)) '^^ 

J] /o(exp(nc)A) / m /,(exp((Z)aru)A) J du + oL'f{ 



s 

' w L ,, 



C<ZE •'^ \i=l / \ t=0 / 

where uc G C Each cube C can be written as C = B' + B where is a cube in W 
and B' is a cube in the complementary subspace. For every cube B, we take a box map 
LB ■■ M<1™(^) W such that ^^([0, e]'^^°'('^)) = 5. Because w is a rotation, there exists 
Co > such that each of the box maps 

^dim(iy) .^^^^ u'^LBit), V G C{G), n G N, 

is Co-bounded. It was also observed in Section ISTT] that each of these maps is (ci,C2)- 
Diophantine. Hence, Proposition 14.21 imphes that there exists n G (0, 1) such that uni- 
formly on vi, . . . ,Vs G >C(G), 

(4.5) WlLijl + (^«)"'^)^)) '^^ 

flMexp{vi + r^'u;^^LB{t))A)] dt 



_g-dim(Ty) 



[0,e]dim(lV) 



^4 = 1 



i=i ^jj^ / \ i=i 



where o" = minjer'^i, r"^ '^^i • • • '^'"^}. Since this estimate is uniform over ViS, we 
conclude that 



J^/,(exp((Z)a)""6' + (Z)a)"'6)A) ) dbdb' 



\C\ 

1 



\i=l 
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Now it follows from (I4.4p that 

/o(exp(n)A) m /,(exp((Da)"^n)A) ) du 



\i=l 



/o(exp(nc)A)|C| ] n ( / /, dA + O ( (a-- + e^) 

\CCE / i=l ^-^^ ^ \ j=0 



\i\\cf> I 



and by 



/o(exp(tx)A) /,(exp((Da)"«n)A) j d^z = ^ (^^ f., d^i 



j=0 



Finally, taking e = r -we obtain 



^i=l 



/o(exp(n)A) j^J] /,(exp((Z?a)">n)A) j d^z 

= n(/ ^^^'") + (min{r^"i/(^+-),r"2-"i,...,r-^-"-i}--]];i|/i||cfl J . 
i=o ^■^^ ^ \ i=l J 

This completes the proof of Theorem 14.11 under the irreducibility assumption. 

The proof of the general case will be given in the following section using an inductive 
argument. For this purpose, we note that the above argument gives the following stronger 
result: there exists p G (0,1) such that for every hi,..., hi € G and automorphisms 
. . . , /3s of G which preserve A that act trivially on G/G' , we have 

(4.6) l^foix) (^n/i(/i.ft(a"'(x)))^ df,{x) 

= fl([ fidf^) +0 (p"''"^"^•"^~"^'••••"^-"^-^^^||/^lb« ) 
j=0 ^-^^ ^ \ 1=0/ 

uniformly over /ij's and /3i's. Indeed, Proposition 14.21 implies that in (|4.5p we have, more 
generally, 

JW\l^{tl f^i.hMeMv^ + {Day'%)K)^ db 

= n {jj''^'^ +o(y<y--i\\\mc^ , 

and the rest of the proof can be carried out as well. 
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4.2. Proof of multiple mixing in general. We use notation introduced in Section 
13. 2[ In particular, W denotes a (L'a)-invariant subspace of C{G), and we arrange that 
exp{W)A = MA where M is closed connected normal a-invariant subgroup containing 
exp(l^) such that M/{M D A) is compact. 

The nilmanifold X = G/A fibers in a-invariant fashion over the nilmanifold Y = 
G/{MA) with fibers isomorphic to Z = MA/ A ~ M/{M n A), and the disintegration 
formula (|3.1ip holds. Using this disintegration formula, we obtain, similarly to (j3.12p . 

(4.7) I^Mx) (^J^ia^^ix))^ df,{x) 

Ugz) |^n/.(a"'(5)a"'(^))j dfjiziz)^ dmpig). 
We claim that there exists p G (0, 1) such that for every g £ F, 

(4.8) I^Mgz) (^flMa^'{g)a^^{z))^ df,z{z) 

' ljo{9z)dfiz{z)^ n {^jJ^{c^'''{9)z)d^lz{z)^ +o(^p^f\^\f. 



Y \JZ 



F \JZ 



iWcO 



uniformly on g £ F. To prove this claim, we write a^^{g) = airriiXi with a,, £ F, rrii £ M, 
and Xi £ A. Then 

Mgz) ^n/i(a"'(5)«"n^))^ df,z{z) = Ijoigz) |^n/.(a,m,ft(a"'(^)))] d^Lz{z), 



where /3i denotes the transformation of Z induced by the automorphism m i— )• XiinX^ ^, 
m £ M. Note that by Lemma 13.51 the automorphism /3j is trivial on M/M'. Let 

(j)o{z) := fo{gz) and (j)i{z) := fi{aiz), i = l,...,s, with z £ Z. 

Since g and a^'s belong to the compact set F, 

\\4'i\\c'> < ll/illc"; i = 0,...s, 
and since ai(MA) = a"*(5)(MA), 

/ (f)idfiz= / fi{a"-'{g)z)dfj.z{z), i = l,...,s. 
Jz Jz 
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Applying the estimate ()4.6p . we deduce that for some p G (0, 1), 
,(2) (n0^(mift(a"'(z)))) diiziz) 



z 



\i=l 



f[([ <Pidpz)+olp-fl\\Uco] 

i=i ^ V i=0 / 



This implies the claim ()4.8p . Now combining ()4.8p with ()4.7p . we deduce that 

(4.9) l^foix) (jlfi{a^^{x))^ d/i(x) =I^Uy) d^y(y) 



iWco 



i=l 



where the functions /j : y — )■ M are defined by y 1— )■ fi{yz) dpz{z). Clearly, 



fi dp.Y = fi dp. 
Y J X 

Since dim(y) < dim(X), Theorem 14.11 now follows from (j4.9p by induction on dimension. 
5. EQUIDISTRIBUTION of UNSTABLE MANIFOLDS 

In this section we prove an equidistribution result for unstable manifolds. Besides its 
own intrinsic interest, we will use this later in our treatment of probabilistic limit theorems 
in Section [6l 

Let a be an ergodic automorphism of a compact nilmanifold X = G/A. We denote by 
W"' C JC-{G) the unstable subspace of Da, namely, the subspace of £(G) spanned by Jordan 
subspaces of Da with eigenvalues A satisfying |A| > 1. Note that since [VK", VF"] C W"', 
exp(VF°) is a Lie subgroup of G. We decompose TV" as a direct sum = ©^^^VF", 
so that Da\w^ acts as a (real) Jordan block. Namely, each subspace has a basis 
{wi, . . . ,Ws} such that 

(5.1) {Da)wi = Xwi + 'Wi-^-l, i < s, 

{Da)ws = Xws, 

where A is a real eigenvalue of Da, or a basis {'Wi,Wi, . . . , Ws,w'g} such that 

(5.2) {Da)wi = awi + hw[ + Wj+i, {Da)w[ = —hwi + aw[ + w^+i, i < s, 

(5.3) {Da)ws = aws + bw'g, {Da)w'g = —hws + aw'^, 

where A = a + 6i is a complex eigenvalue of Da. We order the subspaces with respect 
to the size of |A|. Then 

(5.4) [W^,Wt](l®j>iW^. 
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For each i, we define a map — )• exp{Wa) which is either 

tpi : (ii, . . . 1-^ exp(ti-u;i) • • • exp{tsWs) 

in the real case, or 

Tpi : {ti,t'i . . .,ts,t'^) ^ exp{tiwi +t[w[) ■ ■ ■ eyip{tsWs + t'^w'^) 

in the complex case. Let ip : ]R<iim(VK°') _^ exp(Vl^°) be the product of the maps ipi. It 
follows from (|5.4p that -0 is a diffeomorphism and that the image of the Lebesgue measure 
gives the Haar measure on exp(T^") O 1.2.7]. 

Theorem 5.1. Let a be an ergodic automorphism of a compact nilmanifolds X = G/A. 
Then there exist k = k{9) > and p = p{9) € (0, 1) such that for every box B C 1^^1111(1^")^ 
9-Hdlder function / : X — t- M, h € G, and g £ G, we have 

/ f{a^{h^Pib))gA)db= [ / + 0(min(i?)- Vll/llc«)- 

Proof: We give a proof using an inductive argument similar to the proof of exponential 
mixing in Section [3l 

Let W = n {w,w) where w is the eigenvector of Da in W". More explicitly, 
W = {wg) or W = {ws,Wg) with notation ()5.ip - (j5.2p . As in Section [3^ we deduce that 
there exists a closed normal subgroup M of G containing exp(l^) such that M/[M n A) 
is compact and for almost all 5 € G, 

(5.5) exp{W)gA = MgA. 

The map ■0 • M'^™(^") — )• exp(l^°) can be written as a product ip = ^ ■ rj with ^ : 
]^dim(Ty")-dim(vi/) _^ exp(T4^") and rj : M<iim(vy) _^ exp(l^), where rj : t ^ exp{tws) or 
r] : {t,t') I— 7- exp(tws + t'w'g) and ^ is the product of the remaining exponential maps 
appearing in ■0. Then 

/ fia''ihijib))gA)db= [ [ f{a^{hi{u)r,{v))gA)dudv, 

JB JC JD 

where C is a box in Mdim(iy")-dim(iy) jj ]^dim{W) g^^j^ ^j^^^^ B = C x D. 

We first show that images of the map rj are equidistributed in a suitable sense. Namely, 
we claim that there exists p G (0, 1) such that for every h £ G and every gA G X such 
that (I53D holds, 

(5.6) ^ f{a^[hr^{t))gA) dt = j ^ f{a^{h)gmA) pz{m) + 0{p^f\\ce), 

where pz denotes the invariant normalised measure on the nilmanifold Z = M/{M n A). 
Let Fo C G be a bounded subset such that G = FqA. Then there exists a bounded subset 
F of G such that G = FMigoAg^'^) for all go £ Fq. Indeed, we can take F = FqFq^. We 
note that in ()5.6p we may assume that g £ Fq, and to simplify notation, we replace A by 
gAg~^. Then ()5.6p holds with g = e. 

Next we write a^{h) = am\ with a £ F, m £ M, and A G A. Then 

(5.7) / f{a^{hr,{t))A)dt= [ f{aml3{a^{r]{t)))A)dt, 

JD JD 
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where /3 denotes the automorphism of M defined by m i— )■ AmA^^. We note that /3 
acts triviahy on M/M' by Lemma 13.51 To analyse (j5.7p . we apply Corollary 12.31 to the 
nilmanifold Z = M/{M n A). Setting (j){z) := f{az), z £ Z,we get 

/(am/3(a"(7?(t)))A) (it = / ^{mP{a''{i]{t)))A) dt, 
D Jd 

and since a £ F, we have 

11011c'' « ll/llc«- 

For the next computation, let us assume that dim(VF) = 2. When dim(VF) = 1, the proof 
is similar and simpler. We observe that Da\w = "tuj where r > 1 and u is a, rotation of 
W , so that 

/3(Q"(?7(t,t'))) = exp(r"(t(D/3a;"w;,) + t'(D/3w"w;^))). 
Making a change of variables, 

(/'(m/3(a"(7?(t)))A) dt = r'^" i (f){m exp(i„,(t))A) dt, 

D Jr"D 

where t„ denotes the box map (t, t') ^ t{D/3uj"-Ws)+t'{D(3uj"-w'g). We note that {D'K){Df5) = 
Dt:. Since exp(VF)A = MA, it follows that DirlyV) is not contained in any proper ra- 
tional subspace. In particular, it follows from Lemma 13.31 and [21 Th. 7.3.2] that DniyV) 
contains a vector w satisfying the Diophantine condition (j2.14p . Since w is an isometry, 
this implies that the box map in is (ci, C2)-Diophantine where ci,C2 are uniform in n and 
/3 (see Remark 12. 2p . Therefore, Corollary 12.31 implies that there exists k > such that 

/ </>(m/3(exp(i„(t)))A)dt= / <P dixz + 0{uiiu{r'' DT'^UWce) 

This shows that 
1 

\D 



D 



f{amf3{a^{r^mA)dt= / f{az) dfiz{z) + 0{mm{D)-^r-^m\\ce) 

f{a^{h)z) dfiziz) + 0(min(i3)- Vll/llc«) 



with p = r'^ £ (0, 1). This proves (|5.6p . 

Next, we apply the above argument inductively. For a Holder function / on X = G/A, 
we define a function / on X = G/MA by 



Clearly, 



figMA) := / f{gmA)dfiz{m) 

JM/{MnA) 



Let G = G/M, A = (MA)/M, and p : G ^ G be the projection map. Then X ~ G/A. 
We note that DpiVV^) is precisely the unstable space of Da acting on C{G). It follows 
from ()5.6p that there exists p € (0, 1) such that 

^ ^ /(a"(/iV(6))5A) db = j^J^ f{a^{hm)m db + 0(min(i?)-V-||/bO, 
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where ip is the product of the maps of the form 

ipi : {ti, . . . ,ts) 1-^ exp{tiwi) ■ ■ ■ exp{tsWs), 

or 

ipi : {ti,t[ . . . 1-^ exp{tiwi + t[w[) ■ ■ ■ expitsWs +t'^w'g). 

with Wi = Dp{wi) and w[ = Dp{w[), h = p{h) and g = p{g). In this product we may skip 
terms with = or u)^ = (note that if = 0, then w[ = Q and conversely). Then the 
relations (I5.ip - (l5.2p are still satisfied. In particular, the last exponential in the obtained 
product corresponds to the subspace Dp{W'^) n {w^ w) where w is an eigenvector of Da in 
C{G) with the eigenvalue of maximal modulus. Now we can again apply the argument as 
in the proof of (15. 6p reducing the number of terms in the product defining ifj. Repeating 
the same argument repeatedly, we deduce that for some p G (0, 1) and k > 0, 



^ / /(a"(/iV(&))5A) dh= f f{a''{h)gmk) dfizim) + 0(min(i?)-Vb He" J 

\^\ Jb JM/{MnA) 



where M is a closed normal a-invariant subgroup containing exp(l^") such that M/(MnA) 
is compact. We observe that Da acting on C{G/M) has no eigenvalues with absolute value 
greater than one. Since a is ergodic, it follows from Lemma 13.21 that M = G. This proves 
the theorem for the set oi g £ G that satisfy (jS.Sp at every inductive step, with the estimate 
which is uniform over g. Since this set has full measure, we conclude that the estimate 
holds for all g completing the proof of the theorem, o 

The following corollary will be used in the proof of the limit theorems in the next 
section. 

Corollary 5.2. Let 0, be a domain in W" with a piecewise smooth boundary. Then there 
exist K = k{9) > and p = p{6) G (0, 1) such that for every 9 -Holder function / : X — )■ M, 
g £ G and e > 0, we have 

f{a''{m)9^)db = M ! fdp + 0{{\dM+e-^P''M)\\fM, 
where d^Q, denotes the e -neighbourhood of the boundary ofVl. 
Proof: We tessellate W"' by cubes B of size e. Then 

^-[j B 



Ben 



< \d,n\ 



and 



f f{a^m)9^)db=Y^ I f{a''im)9^)db + 0{\dM\\f\\c'^) 



Ben ■ 

By Theorem 15. H for some k > and p £ (0, 1), 



/ f{a''{ijib))gA)db = \B\ [ f dp + 0{\B\e-^p' 
Jb Jx 



CO) 
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CO 



Therefore, 

/ f{a^{m)9^)dh=[Y,\B\] [ fdfi + oll\dM+Y.\^\'~''Pj 
•^^ \Bcn / -'^ W Ben / 

= \n\ [ fdfi + omn\ + Me-^pn\\f\\co)- 

Jx 

This completes the proof of corollary, o 

6. Central limit theorem and invariance principles 

Let us first review the terminology regarding the central limit theorem and other prob- 
abilistic limit theorems. Let a : X ^ X he a measure-preserving map of a probability 
space {X,fi). For a function / : X — t- M, we consider a sequence of observables / o a". If 
the dynamical system a r\ X is sufficiently chaotic, this sequence is expected to behave 
similarly to a sequence of independent random variables. We set 

ra-l 

5„(/,x) = j;/(a*(x)), 

i=0 

and for simplicity assume that f^fdfj, = 0. 

The sequence / o a" satisfies the central limit theorem if there exists cr > such that 
n^^^'^Snif,-) converges in distribution to the normal law with mean and variance a^. 
More generally, the sequence / o a" satisfies the central limit theorem for subsequences if 
there exists cr > such that for every increasing sequence of measurable functions kn{x) 

taking values in N such that for almost all x, lim„_!.oo ^"^^^ = c for some fixed constant 
< c < oo, the sequence n~^/^5fc^^(.)(/, •) converges in distribution to the normal law with 
mean and variance cr^/c. We define St{f,x) for all t > by linear interpolation of its 
values at integral points. The sequence / o a" satisfies the Donsker invariance principle if 
there exists a > such that the sequence of random functions {na"^)"^/"^ Sntif, •) G C([0, 1]) 
converges in distribution to the standard Brownian motion in C([0, 1]). The sequence foa" 
satisfies the Strassen invariance principle if there exists cr > such that for almost every 
x, the sequence of functions (2ncr^ log log n)~-'^/^5„t(/, x) is relatively compact in C([0, 1]) 
and its limit set is precisely the set of absolutely continuous functions g on [0, 1] such that 
ff(0) = and g'{tf dt<l. This is a strong version of the law of the iterated logarithm. 

In this section we establish the above limit theorems for sequences generated by ergodic 
automorphisms of compact nilmanifolds. In the case of toral automorphism, these theo- 
rems have been established by LeBorgne [T7] using the method of martingale differences, 
and we follow a similar approach. We shall use the following general result: 

Theorem 6.1. Let {X, B, fi, a) be an invertible ergodic dynamical system and f G Lp'i^X) 
such that j-^fdjj, = 0. Let A be a sub-a-algebra of B such that An = a~^{A) is a 
non-increasing sequence of a-algebras satisfying 

(6.1) Y.\\E{f \ An)h < oo and ||/ - i?(/ | ^„)||2 < oo. 

n>0 n<0 
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Then 

(i) = J^fdfi + 2 ZT=i Ixif ° df^ fi^'i^- 

(ii) a = <^ f is an L'^ coboundary <^ f is a measurable coboundary. 

(iii) If a > 0, then / o a"" satisfies the central limit theorem, the central limit theorem 
of subsequences, and the Donsker and Strassen invariance principles. 

It is well-known (see, for instance, [34^ Theorem 4.13]) that under the assumption (j6.ip 
the function / has a decomposition f = {(f)oa — (f))-\-ip with 4',Tp G Lp'{X), where ■0 ° a" 
is a reverse martingale difference with respect to the a-algebras An, and a = \\ip\\2- In 
particular, a < oo and if cr = 0, then / is an coboundary. On the other hand, if / is a 
measurable coboundary, then ip is also a measurable coboundary, and it follows from [31] 
that = 0, so that (7 = 0. For (iii) we refer to [13l Ch. 5]. 

The following is the main result of this section: 

Theorem 6.2. Let a be an ergodic automorphism of a compact nilmanifold X, and let f 
be a Holder function on X which has zero integral and is not a measurable coboundary. 
Then the sequence f o satisfies the central limit theorem, the central limit theorem of 
subsequences, and the Donsker and Strassen invariance principles. 

To find the sub-ci-algebra A suitable for Theorem 16. H we use the results of Section [5] 
combined with the works of Lind [21j and Le Borgne |17j . We call a measurable partition 
V oi X 5 -fine if the diameter of any set in V is at most 5. We say that a partition generates 
under a if the u-algebra generated by all a^iV) with n € Z is the Borel <T-algebra of X 
modulo null sets. Given a partition V and a; G X, we denote by V{x) the element of the 
partition that contains x. Given integers k < I, we denote by the partition generated 
by a-''(V), . . .,a-\V). We also set P^(x) = r\i>kVi{x). 

Proposition 6.3. Let V be a finite measurable partition of X such that for every P gV, 

• P is the closure of its interior, 

• the boundary of P is piecewise smooth, 

• the diameter of P is at most 5. 
Then if 5 is sufficiently small, 

(i) the partition V generates under a, 

(ii) for almost every x, the atoms V^{x) are contained in the stable manifolds ^(x) 
of X, and the diameter ofT'^{x) in W*(x) is bounded, 

(iii) for almost every x £ X, the atoms V^{x) have non-empty interior in the stable 
manifolds W^{x). 

Proof of (i)-(ii). The proof follows that of [211 Th. 1] almost completely albeit with 
some differences in the final argument involving isometrics. We will show that a almost 
surely separates points, i.e., that for some null set Xq in X, ii x,y £ X\Xq, then for some 
n, the points a"(x) and a'^{y) belong to different elements of the partition V. It then 
follows from Rohklin's work [28] that V generates under a. 

There exist cq > 1 and 6o > such that for every w G ^{G) satisfying < 6o and 
x£X, 

(6.2) Cq^ \\w\\ < d{x,exp{w)x) < cq 
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We assume that 5 is sufficiently small, so that ||Da||co(5 < 6q, and if p and q belong to the 
same element P of the partition, then q = ex.p{w)p with \\w\\ < 60. Since diam(P) < 5, 
we have \\w\\ < cqS. We observe that 

(6.3) (i(a"(p),a"(g)) = d(a"(p), exp((L'a)"z/;)a"(p)). 

Suppose that || (-Da)'^t(;|| — )• 00 as n — )• 00. We pick the greatest n > such that 
||(L>a)"w|| < C06. Then 

co<5 < ||(Da)"+^u;|| < \\Da\\cod < 60, 

and it follows from (I62])~(I63D that (i(a"+^(p), a"+^((?)) > 6. Hence, a"+Hp) and a"+i(g) 
belong to different elements of the partition. 

A similar argument also applies when ||(Z)Q)"'it;|| — t- 00 as n — )• —00. Therefore, it 
remains to consider the case when w G which is the span of eigenspaces of Da with 
eigenvalues of modulus one. We adapt Lind's idea |2I] for this situation. Let K denote 
the closed group of isometrics generated by /3 := Dal^iao. Then f3 acts ergodically on K 
by translations. Since a is mixing, the product a x /3 acts ergodically on X x i^. It follows 
from ergodicity and Fubini's theorem that there exists a null set Xq C X and k € K such 
that the sequence (q"'(x), /3"/c) is dense in X x K for every x € X\Xq. Then the sequence 
(q"(x), /3") is also dense in X x K. 

Now suppose that p,q G ^\^o and q = exp{w)p for some nonzero w € E^^°. Given an 
element P £ V, we set 

P{w,e) = {x e P : d{ex.p{w)x,P) > e}. 

When e > is sufficiently small, this set has a nonempty interior. Hence, for every 
p € X\Xq, there exists n such that 

a'^ip) £ P{w,e) and d(exp(u;), exp((i:'a)"u?)) < e/2. 

Then 

d{a''{q),P) = d{exp{{Da)''w)x,P) 

> d{exp{w)x, P) — d{exp{{Da)"'w)x,exp{'w)x) > e/2. 

In particular, a"'{p) G P and a"'{q) ^ P. This proves that V generates under a. The part 
(ii) can be proved by the same argument, o 

To prove Proposition 16.3( 111). we follow Le Borgne's approach [17] for toral automor- 
phisms. We pick c, ro G (0, 1) such that the map a""" expands the distance on by at 
least CTj^" for n > 0, and take r £ (ro, 1). Let 

Vn:={x€X : V^{x) D B^^/^{x) n W{x)}. 

Proposition I6.3( iii) immediately follows from the following lemma. 

Lemma 6.4. ^(X\K) < r'^ ■ 

Proof: Let 

Wn:={y<£X: d{a^{y),dV{a^{y))) > r^r^/c^ for ah j > 0}. 
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If y is in Wn, then V{a^{y)) contains the bah in 'W^{a^{y)) of radius r^r'^/cp'. Hence, 
{V{a^ (y))) contains the ball in W*(y) of radius r"/c. Since 

V^iy) = f^a-^iVia^iy))), 
j>o 

we conclude that Vn D Wn- 

To prove the lemma, it suffices to estimate ^{X\Wn)- It follows from our assumption 
on the partition V that 

fi{{yeX: d{y,dr{y))<e})'^e, 
and since a is measure-preserving, for every j > 0, 

fi{{y G X : d{a^{y),dV{a^y))) < r^r"/c}) « r^. 

Hence, 

which implies the lemma, o 

Proof of Theorem \6.SX Let A be the cr-algebra generated by the partition and 
An = a~"(^) = . It is clear that the sequence An is non-increasing. To prove the 
theorem, it suffices to check the conditions (|6.ip . Since the partition is measurable in 
the sense of [28], for almost every x, 

E{f\An){x) = /(y)c?"ipoo(^.)(y), 

where m-poo^^^^ is the conditional probability measure on T'^{x). 

To verify the second part of (|6.ip . we observe that when Pg°(a"(x)) C W^{x), 

diam{V^{x)) = diam(a""(Po'^(a"(x)))) 

decays exponentially as n — )• — oo uniformly on x. Since the function / is 0-Holder, it 
follows that for some r G (0, 1), 

||/-ii;(/|^„)||2«r-||/|b. and J] ||/ - | A,)||2 < oo. 

71<0 

To check the other condition in (j6.ip . we observe that by Lemma |6.4|, 

(6.4) / |ii;(/|A)|'(i/^«r"||/||^o. 

On the other hand, for x G a~"'{Vn), 

B^n/,(a"(x)) n W'ia'^ix)) C 7'(a"(x)) and S^„^-n(x) n W"(x) C a"" (7^(0" (x))). 
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Since the diameter of V{x) is at most 6, as soon as r'^r^^ > 5, we get that V{x) C 
B rn/r^{x). Hence, by Proposition [6^31 for almost every x £ a "(Ki), 



r log .5 

CXD I log(r/rQ) 

(6.5) r^{x) = f] a-"(P(a"(x))) n W'{x) = f| q-"(P(q"(x))) n W'{x). 

n=0 71=0 

Thus, V^{x) is the intersection of the stable manifold of x with at most finitely many 
sets whose boundaries consist of finitely many piecewise smooth submanifolds. Then 

(6.6) V^{x) = exp{n^)x, 

where 0.x is a domain in the unstable subspace W = W°' ^ of D{a^^) in C{G) whose 
boundary is piecewise smooth and depends smoothly on x. In particular, l^er^^;! <^ e 
uniformly on x G X. It follows from (16. 6p that 

V^{x) = a-^iV^ia^ix))) = exp((I)a)-0,)x. 

Then by [3 Prop. 4.3], 

1 

""^"""^"^ " m.(P-(x))"'"'^"°°(^)' 
where rrix is the Haar measure on exp(W)x. Now we apply Corollary 15.21 It follows from 
the definition of Vn that for x € a~'^{Vn), we have \^}x\ ^ Hence, by Corollary [521 
for every x G a~^{Vn) and e > 0, 



j^^^^^ f{y) druxiv) = O + 6->") 

O((6r-" + 6-V")ll/llc0' 



where p £ (0, 1). We take e = (r"'/9"')^/('^+^). If we also take r sufficiently close to 1, then 
this quantity decays exponentially as n — )■ oo. Then 

\E{f\An)?dp<^Tm\\le 

for some r E (0, 1). Combining this estimate with (j6.4p . we deduce the first part of (|6.ip . 
Now the theorem follows from Theorem 16.11 o 



7. COHOMOLOGICAL EQUATION 

In this section we apply exponential mixing to establish regularity of solutions of the 
cohomological equation. We recall that for ergodic systems the solution is unique up to a 
constant, up to measure zero. 

Theorem 7.1. Let a he an ergodic automorphism of a compact nilmanifold X and f S 
C°°{X) such that f = (j) o a — (p for some measurable function <j). Then (p is almost 
everywhere equal to a C°° function. 
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The method of proof of Theorem 17.11 apphes to other classes of homogeneous partially 
hyperbolic systems for which exponential mixing holds. For instance, we may consider an 
ergodic partially hyperbolic left translation on the homogeneous space G/T, where G is 
connected semisimple Lie group and T is a cocompact irreducible lattice. This dynamical 
system is also exponentially mixing for Holder functions Appendix], and the argu- 
ment of Theorem 17.11 applies. For X = SL(i(M)/SLf;(Z), an analogous result for Holder 
functions / was established in [18]. Furthermore, we get both Holder and smooth ver- 
sions of Theorem 17. II for compact G/T and G semi simple from Wilkinson's general result 
for accessible partially hyperbolic diffeomorphisms [35^ Theorem A] under the additional 
assumption that the left translation projected to any factor of G does not belong to a 
compact subgroup. 

Before starting the proof, we need to develop some language and review a result on 
regularity of distributions. Let M be a compact manifold. We fix a Riemannian metric 
on M, and denote by G^ = G%M) the space of 6i-Holder functions on M. We let (C^)* be 
the dual space to G^ . Note that any smooth function on M naturally belongs to any . 
Hence any element in (C^)* defines a distribution on smooth functions on M. Conversely, 
(C^)* is the space of distributions (dual to C°° functions) which extend to continuous 
linear functionals on . As for notation, we will write the pairing D{g) = {D,g) for 
D G (C^)* and g G C^. 

Let be a foliation on M, and consider a C°° vector field V tangent to J-. Given 
a distribution D on M, define the derivative V{D) by evaluating on C°° test functions 
g as follows: {V{D),g) = —{D,V{g)) where V{g) denotes the directional derivative of g 
along V. 

Given smooth vector fields Vi, . . . ,Vr, we call Vi^, Vi^ . . . Vi^D the partial derivatives of 
order m of D. Suppose that we can cover M with open sets lA such that we can find smooth 
vector fields Vi, . . . ,Vr which span the tangent spaces to T at any point of U. Suppose 
moreover that all partial derivatives of any order m, Vi^, Vi2 ■ ■ ■ ^im^ of ^ distribution D 
belong to (C^)*, for all such choices of lA and Vi, . . .Vr ■ Then for any other C°° vector 
fields F/, . . .V'. tangent to J^, the partial derivatives V/^. . . V-^D also belong to (C^)* 
as follows from a partition of unity argument. Thus we can say that partials along J-" of 
a distribution belong to (C^)*, without any reference to a particular set of vector fieldsl] 

The following result is inspired by results of Ranch and Taylor in , and was known 
to Ranch for the case of C°° foliations. We are not aware of a simple reference. It is also 
a straight-forward consequence of a similar much more technical result for Holder folia- 
tions proved in [10], namely that the wavefront set of a distribution for which the partial 
derivatives of all orders along a single foliation belong to the dual of Holder functions is 
co-normal to the foliation. We refer to [271 [TO] for more details. 

Corollary 7.2 ([iQj). Let J^i, . . . , J> be C°° foliations on a compact manifold M whose 
tangent spaces span the tangent spaces to M at all points. Consider a distribution D 
defined by integration against an function cj). Assume that any partial derivative of D 
of any order along the foliations J-i, . . . ,J-r belongs to (C^)* for all 9 > 0. Then (j) is C°° . 



In our application we will have globally defined vector fields for which the partials exist for all orders, 
and we will not need this comment. 
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We are now ready to tackle the proof of Theorem 17.11 Let us first give an outline 
of the argument. Using Theorem 16.11 we first show in Lemma 17.31 that the function (p 
has to be in L'^{X). Then we describe (f) as distribution. We consider three dynamically 
defined foliations for a: the unstable foliation W", the stable foliation W^, and the central 
foliation W^. The unstable foliation is tangent to the right invariant distribution on X 
corresponding to the sum of all generalized eigenspaces with eigenvalues |A| > 1, the stable 
foliation is tangent to the right invariant distribution on X corresponding to the sum of all 
generalized eigenspaces with eigenvalues |A| < 1, and the central foliation is tangent to the 
right invariant distribution on X corresponding to the sum of all generalized eigenspaces 
with eigenvalues |A| = 1. Note that these distributions are integrable as is easily seen by 
taking Lie brackets. We show that the distribution derivatives of (p along the foliations 
W*, W", W"^ of a define distributions on Holder functions. This is established in Lemmas 
17.41 and 17.51 Since all these foliations are smooth, Cor oUar v 1 7 . 2 1 shows that the function (p 
is C°°. 

We now establish Lemmas 17.31 17.41 and 17.51 which will finish the proof of Theorem 17.11 



Lemma 7.3. The function (p in Theorem 7.1 is in L 



Proof: Recall that along the proof of Theorem 16.21 we have verified the conditions of 
Theorem 16.11 Hence, the lemma follows from part (ii) of this theorem, o 



Define the distributions and P by evaluating them on test functions g G C°°{X) 

by 

oo oo 

P+(.9) = Y.{foa\g) and P" (g) = J^if ° d) ■ 

i=0 i=l 

Note that f dfi = since / is an coboundary. Hence, by exponential mixing (Theo- 
rem ll.ip . these sums converge as long as the test function g is Holder, and P~^,P~ G (C^)*. 
Moreover, since {(p o a'^,g) — t- as z — ?• ±cx). we get by a telescoping-sum argument that 

oo oo 

P^ig) = y,{f ° = V(0 o - 4> o a\g) = lim (</. o - <P,g) = -{<P,g). 

^ — ' ^ — ' Af— >oo 

Similarly, we see that P~{g) = {(p,g)- Hence, the distribution P^ = —P~ is given by 
integration against the L^-function (p. We will use this to show that (p is smooth. 

According to Corollary 17.21 it suffices to show that partial derivatives of all orders of 
the distribution P~^ = —P~ along any of the three foliations W**, W" and belong to 
(C^)* for any 9 > 0. We will show this in the next two lemmas. 

Lemma 7.4. Partial derivatives of all orders of the distribution P~^ = —P~ along 
and W" belong to (C^)* for any 6 > 0. 

Proof: Let ^ be a right invariant vector field tangent to and g a C°° test function. 
Then 

oo oo 

= -{P^,V{g)) = -Y^{foa\V{g))=Y,{V{foa^),g). 

1=0 i=0 
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The derivative V{f o a*) decays exponentially fast since V is tangent to W^. Hence, 

\{ViP+),g)\^\\g\\co, 

and in particular, V{P^) G (C^)* for all ^ > 0. Since = —P~, an analogous proof 
shows that V{P~^) lies in the dual of Holder functions for all vector fields V tangent to W". 
A similar argument also applies to higher order derivatives along vector fields tangent to 
W or W". We refer for the details to [lOl Lemma 5.1]. o 

Finally, we show that partials of all orders of P"*" = —P~ along are distributions 
on Holder functions. This argument uses exponential decay very strongly, and was first 
discovered in [10]. For a detailed account we refer to \10\ Lemma 5.1]. 

Lemma 7.5. Partial derivatives of all orders of the distribution P^ = —P~ along 
belong to (C^)* for any 9 > 0. 

Proof: Let ^ be a right invariant vector field tangent to W^, and let ghe a C°° function. 
Then the partial derivative of P'^ along V is given by 

oo oo 

(7.1) {V{P^),g) = Y.{V{f oa^),g) = -Y^{foa\ V{g)), 

i=0 i=0 

and we have estimates for all of these expressions in terms of the Holder norm of V{g), 
due the exponential mixing of a. We will show that this distribution extends to Holder 
functions g by approximating g by smooth functions g^ and carefully balancing the speed 
of the approximation with the loss of exponential decay due to the growth of the C'-norm 
of More precisely, we shall show that there exists ^ = ^(0) G (0, 1) such that for every 
g € C^{X) and sufficiently large i, 

(7.2) \{V{foa'),g)\ «r-||/||ci|bllc«- 

It would follow from (HH) and ^ that V{P+) G (C^)*. 

We recall from Lemma 12.41 that for e > 0, there is a C°° function g^ such that 

(7.3) \\ge - g\\co < e'^WgWce and Ibellc^ < '^"'""^Ibllco 

where m = dim(X). We first estimate \{V{f o a^),ge)\- By the exponential mixing (The- 
orem fTTT]) and since V is bounded, we have for some p G (0, 1), 

(7.4) \{foa\V{ge))\ « plf\\c4y{9e)\\c^ « plfWc^ e-"^-'\\g\\co. 

On the other hand, we can estimate |(/ o a% V{g — gs))\ = \{V{f o a'''),g — as follows. 
First, we note that the derivatives y(/oa*) by the chain rule are composites of derivatives 
of / and derivatives of a* along W^. The latter grows at most polynomially since is 
the central foliation for a. Hence, for any rj > 0, there is G Z+ such that 

||^(ai>V-)|| < (1 + for all i > ir,. 

Hence, for all i > i^, we get the estimate 

im/o«^)llco<(l + r?)^||/||ci, 
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and 

(7.5) \{V{f o a^),g -g,)\< \\V{f o a^)\\co \\g - <7e|bo < (1 + vYWfWc^ e'ibllc- 

We have exponential decay with respect to i in (j7.4p . but exponential growth in (jZ.Sp at 
first sight. However, choosing e carefully depending on i, we can still achieve exponential 

i 

decay in (jT.Sp . and hence for \{V{f o a^),g)\. More precisely, we take e = pe+m+2 _ Then 
we obtain from (|7.4p that 

\{f o a\V{ge))\ « (p^)' ll/lbi Iblico, 
and from ()7.5p that for i > irj, 

\{V{foa'),g-ge)\ < ((1 + ||/||ci||5llc«- 

Now we choose r/ > so that ^ := (1 + ry)ps+™-+2 < 1. Finally, we obtain from the last two 
inequalities that for z > i^. 

This proves (|7.2p and shows that V{P'^) extends to a continuous linear functional on the 
space of 0-Holder functions. A similar argument shows that higher order derivatives of 
along the central foliation define distributions dual to Holder functions. For the details 
we refer to [10^ Lemma 5.1]. o 

This finishes the proof of Theorem 17. li 

8. Bernoulli property 

Here we show that ergodic automorphisms on compact nilmanifolds are Bernoulli com- 
bining results from [13], [23], and [29]. It was already shown in [25] that such automor- 
phisms satisfy the Kolmogorov property. 

Theorem 8.1. Ergodic automorphisms on compact nilmanifolds are Bernoulli. 

Proof: Let a be an ergodic automorphism of a compact nilmanifold X = G/A. We will 
argue by induction on the dimension of X. We note that when X is a torus, this result 
was established by Katznelson in [H] , and this forms the base of induction. Let Z be the 
centre of G. It follows from [5l 5.2.3] that ZA is a closed subgroup of G. Then a r\ X 
is measurably isomorphic to a skew product with the base a r\Y = G/{ZA) and fibers 
isomorphic to the torus T = ZA/A, where the action on the fibers is by affine linear maps 
t ^ Zy + a{t), Zy G Z. We consider two cases. 

First, suppose that the automorphism a acts ergodically on the torus T. Then it follows 
from Marcuard's theorem [231 Theorem 4] that a r\ X is measurably isomorphic to the 
direct product of the systems a r\ Y and a r\ T. Hence, it follows from the inductive 
assumption that a r\ X is measurably isomorphic to the product of two Bernoulli maps, 
and thus Bernoulli. 

Second, suppose that the action of a on the torus T = ZA/A is not ergodic. Then T 
contains a nontrivial subtorus Tq = ZqA/A, where Zq is a closed connected subgroup of 
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on which a acts isometrically, and a r\ X is measurably isomorphic to a skew product 
with the base a r\ G/{ZqK) and the fibers isomorphic to torus To, where the action on 
the fibers is by affine hnear maps t ^ Zy + a(t), Zy E Zq. We note that this is an isometric 
extension of the base, and by the inductive assumption, the base is Bernouhi. Hence, we 
can apply Rudolph's theorem j29j which shows that weakly mixing isometric extensions 
of Bernoulli maps are Bernoulli, o 
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